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Decoded pro 
' values 
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Collect profile 
trace-packets? 1 


4) 




I-TLB 
property bi 


< 

83 


! 

■Q 
oM 


Protected . 


j Interpretation 

j 


Instructions set 


Probe for 
translated co 


I/O memory 
reference 
exceptions 


00 


Tap 


Tap 


no 


Native code observing native 
RISCy calling conventions 


Native 
decoder 


No 


No 


Fault 
if SEG.tio 


01 


Tap 


x86 


no 


Native code observing x86 
calling conventions 


Native 
decoder 


No 


No 


Fault 
if SEG.tio 


10 


x86 


x86 


no 


x86 code, unprotected - 
TAX! profile collection only 


x86HW 
converter 


If enabled 


No 


Trap 
if profiling 


11 


x86 


x86 1 


yes 


x86 code, protected - 
TAX! code may be available 


x86HW 
converter 


If enabled 


Based on I- 
TLB probe 
attributes 


Trap 
if profiling 
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Fl^ ; i Significance of the I-TLB property bits 



ISA & CC transition exception flow 
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T 





name 


description 


type 




VECT_call_X86_CC 


push args, return address, set up x86 state 


fault on target instruction 




VECTJump_X86_CC 


set up x86 state 


fault on target instruction 




. VECT_ret_no_fp_X86_CC 


return value to eax:edx, set up x86 state 


fault on target instruction 




VECT_ret_fp_X86_CC 


return value to x86 fp stack, set up x86 state 


fault on target instruction 




VECT_calLTAP_CC 


x86 stack args, return address to registers 


fault on target instruction 


TSL~ 


VECTJump__TAP_CC 


x86 stack args to registers 


fault on target instruction 


ZS**- 


VECT_ret_no_fpJTAP_CC 


return value to RV0 


fault on target instruction 


2S£>2- 


VECT_ret_any_TAP_CC 


return type unknown, setup RV0 and RVDP 


fault on target instruction 




VECT_ret_any_TAP_CC return type unknown, setup RV0 and RVDP fault on target instruction 

F% n ;CC transition exceptions 




Transition ( source => dest ) 
ISA & CC property values 


Handler Action 


00 =>00 


No transition exception 


00 =>01 


VECT_xxx_X86_CC exception - handler converts from native to x86 conventions 


00 => lx 


VECT_xxx_X86_CC exception - handler converts from native to x86 conventions, 

sets up expected emulator and profiling state 


01 => 00 


VECT_xxx_TAP_CC exception - handler converts from x86 to native conventions 


01 =>01 


No transition exception 


01 => lx 


VECT.X86JSA exception [conditional based on PCW,X86_ISA_ENABLE flag] 
- sets up expected emulator and profiling state 


lx=> 00 


VECT_xxx_TAP_CC exception - handler converts from x86 to native conventions 


lx=>01 


VECT_TAP__ISA exception [conditional based PCW.TAPJSA_ENABLE flag] 
- no convention conversion necessary 


lx=> 10 


No transition exception - [profile complete possible, probe possible] 


lx => 11 


No transition exception - [profile complete possible, probe NOT possible] 
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Flat 32-bit "Near" Address Space 



x86? RISC? 



Transparency: 

. x86 code adheres to traditional 

x86 stack-based conventions 
. RISC uses higher performance 

register-based conventions 
. Caller has no knowledge 

of callee's ISA 
. Callee has no knowledge 

of ISA to which it will return 




Flat 32-bit "Near" Address Space 




x86 RISC transition: 
map x86 call to RISC 

32-2- CPfj-'SK) 



RISC x86 transition: 
map x86 return to RISC 



no ISA transition: 
no mapping required 



406036_1 



Flat 32-bit "Near" Address Space 



■RISC 




1 



RISC-* x86 transition: 
map RISC call to x86 



x86-» RISC transition: 
map RISC return to x86 

32.9,332- CF,- r 3vQ 



no ISA transition: 
no mapping required 



R«. 3 ^ 
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11 



Flat 32-bit "Near" Address Space 



RISC 



call;?- 




ill 



*x86 -> RISC transition: 
Jnap RISC return to x86 



RISC -» x86 transition: 
map RISC call to x86 
'343 -34g > 0^-30 



no ISA transition: 
no mapping required 
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Flat 32-bit "Near" Address Space 




RISC -> x86 transition: 
map x86 return to RISC 

34^ 



x86-» RISC transition: 
map x86 call to RISC 

322 (f;-,. 3W} 



no ISA transition: 
no mapping required 
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x86 Preamble: 
(need not be inline) 



3\? 



Load register args 

Fill-in RXA (return transfer argument area) 



General_Entry: 



YES 



3\7 



XD == 0? 



NO 



i 



N 


ative Entry: — * 

Native"Preamble: 

(typically vacuous) 
- Varargs 




3vS 




- AP for a very big argument list 




! omit if \ 




' NATIVE_ONLY _j 


< 



Function Body: 



setupXD: 

XD <r- <descriptor_constant> 



RET 



X86-to-Tapestry transition exception handler ^ 

// This handler is entered under the following conditions: 
// 1. An x86 caller invokes a native function 
// 2. An x86 function returns to a native caller 

// 3. x86 software returns to or resumes an interrupted native function following 
// an external asynchronous interrupt, a processor exception, or a context switch 

dispatch on the two least-significant bits of the destination address { 
case "00" // calling a native subprogram 

// copy linkage and stack frame information and call parameters from the memory 

// stack to the analogous Tapestry registers 

LR <r- [SP++] // set up linkage register ~ 32.3 f 32£ 

AP <- SP // address of first argument 324 

SP«-SP-8 // allocate return transfer argument area — 32.^ 

SP <- SP & (-32) // round the stack pointer down to a 0 mode 32 boundary — 327 
XD ^ 0 // inform callee that caller uses X86 calling conventions ~* 328 

Q case "01" // resuming an X86 thread suspended during execution of a native routine 

\§ if the redundant copies of the save slot number in EAX and EDX do not match or if "2 3-7 ( 
U! the redundant copies of the timestamp in EBX:ECX and ESLEDI do not match { j 

Up // some form of bug or thread corruption has been detected 

IV goto TAPESTRY_CRASH_S YSTEM( thread-corruption-error-code ) ^ 37 2- 

! v } 

I? j save the EBX:ECX timestamp in a 64-bit exception handler temporary register "? — - - y 37& 

W (this will not be overwritten during restoration of the full native context) £ 

use save slot number in EAX to locate actual save slot storage 374- 
restore full entire native context (includes new values for all x86 registers) -~37S 
if save slot's timestamp does not match the saved timestamp { 37 U 

II save slot as been reallocated; save slot exhaustion has been detected 
goto TAPESTRY_CRASH_SYSTEM( save-slot-overwritten-error-code ) ~ 377 

O } 1 
■ free the save slot ^- 378 J 

case "10" // returning from X86 callee to native caller, result already in registers 

RV0<63 :32> <r- edx<3 1 :00> // in case result is 64 bits ~ 33 3 L 332. 

convert the FP top-of-stack value from 80 bit X86 form to 64-bit form in RVDP ~* ] 
SP ESI // restore SP from time of call ~337 J 

case "11" // returning from X86 callee to native caller, load large result from memory "7 

RV0..RV3 <r- load 32 bytes from [ESI-32] // (guaranteed naturally aligned) ^* 33o I Z23 
SP <r- ESI // restore SP from time of call ~- 3^ 7 J 

} 

EPC <r- EPC & -4' II reset the two low-order bits to zero " 33-t> 
RFE ^ 33© 



Fig. 3h 
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Tapestry-to-X86 transition exception handler 

// This handler is entered under the following conditions: 
// 1. a native caller invokes an x86 function 
// 2. a native function returns to an x86 caller 
switch on XD<3:0> { 3^ <^ 

XDRETFP: // result type is floating point 

F0/F1 <- FINFLATE.de( RVDP ) // X86 FP results are 80 bits 
SP <~ from RXA save // discard RXA, pad, args 

FPCW <- image after FINIT & push // FP stack has 1 entry 
goto EXIT 

XD_RET_WRITEBACK: // store result to @RVA, leave RVA in eax 

RVA <- from RXA save // address of result area 

copy decode(XD<8:4>) bytes from RV0..RV3 to [RVA] 
eax <- RVA // X86 expects RVA in eax 

0 SP <- from RXA save // discard RXA, pad, args 

FPCW <- image after FINIT // FP stack is empty 

goto EXIT 



34^ 



XD_RET_SCALAR: // result in eax:eda 

edx<3 1 :00> <- eax<63 :32> // in case result is 64 bits 

SP <r~ from RXA save // discard RXA, pad, args 

FPCW <- image after FINIT // FP stack is empty 

goto EXIT 



XDC ALLHIDDENTEMP : // allocate 32 byte aligned hidden temp 

esi <- SP // stack cut back on return 

SP <- SP - 32 // allocate max size temp "> 

RVA<-SP //RVA consumed later by RR 3 

LR<1 :0> <- "1 1" // flag address for return & reload ~ 3<VS 
goto CALLCOMMON 



// remaining XD_CALL_xxx encodings 
// stack cut back on return *>- 
// flag address for return - *— i^4> 



default: 

esi «- SP 
LR<1:0><-"10" 
CALLCOMMON: 

interpret XD to push and/or reposition args ^» "i«+7 
[~SP] <- LR // push LR as return address 

EXIT: 

setup emulator context and profiling ring buffer pointer 

} 

RFE // to original target 



} 



Fig. 3i 
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^S5D 

interrupt/exception handler of Tapestry operating system: ^ 

// Control vectors here when a synchronous exception or asynchronous interrupt is to be 
// exported to / manifested in an x86 machine. 

// The interrupt is directed to something within the virtual X86, and thus there is a possibility 
// that the X86 operating system will context switch. So we need to distinguish two cases: 
// either the running process has only X86 state that is relevant to save, or 
// there is extended state that must be saved and associated with the current machine context 
// (e.g., extended state in a Tapestry library call in behalf of a process managed by X86 OS) 
if execution was interrupted in the converter - EPC.ISA = X86 { 

// no dependence on extended/native state possible hence no need to save any. f 3Sl_ 
goto EM86_Deliver_Interrupt( interrupt-byte ) J 

} else if EPC.Taxi_Active { 

// A Taxi translated version of some X86 code was running. Taxi will rollback to an 
// x86 instruction boundary. Then, if the rollback was induced by an asynchronous external 
// interrupt Taxi will deliver the appropriate x86 interrupt. Else, the rollback was induced 
p // by a synchronous event so Taxi will resume execution in the converter, retriggering the 
|i // exception but this time will EPC.ISA = X86 
!jj goto TAXi_Rollback( asynchronous-flag, interrupt-byte ) 
j J else ifEPC.EM86 { 



3ST> 



111 
: -sir 

b=5»s 



4 else { 



// The emulator has been interrupted. In theory the emulator is coded to allow for such ^ r 
// conditions and permits re-entry during long running routines (e.g. far call through a gate) 
// to deliver external interrupts 
goto EM86_DeliverJnterrupt( interrupt-byte ) 



// This is the most difficult case - the machine was executing native Tapestry code on 
// behalf of an X86 thread. The X86 operating system may context switch. We must save 
// all native state and be able to locate it again when the x86 thread is resumed. 

allocate a free save slot; if unavailable free the save slot with oldest timestamp and try again 

save the entire native state (both the X86 and the extended state) "7 _ ^ « 

save the X86 EIP in the save slot J> 

overwrite the two low-order bits of EPC with "01" (will become X86 interrupt EIP) ^ 3^3 

store the 64-bit timestamp in the save slot, in the X86 EBXiECX register pair (and, ? 

for further security, store a redundant copy in the X86 ESLEDI register pair) O 
store the a number of the allocated save slot in the X86 EAX register (and, again for c 

further security, store a redundant copy in the X86 EDX register) S 
goto EM86_Deliver_Interrupt( interrupt-byte ) 3^ 



35o 
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typedef struct { 
save_slot_t * 
saveslott * 
unsigned int64 
unsigned int64 
unsigned int64 

timestamp_t 
int 

boolean 
} save_slot_t; 



newer; 
older; 
epc; 
pew; 

registers[63]; 
timestamp; 



379 



// pointer to next-most-recently-allocated save slot 7 
// pointer to next-older save slot _j 
// saved exception PC/IP 

// saved exception PCW (program control word) L 33 £> 
II save the 63 writeable general registers 
// other words of Tapestry context 



// timestamp to detect buffer overrun ^ 
save_slot_ID; // ID number of the save slot ~ 3^7 
save_slot_is_fiill; // full / empty flag — ^ 3S9 




save_slot_t * 
save slot t * 



save_slot_head; 
save_slot_tail; 



// pointer to the head of the queue 
// pointer to the tail of the queue 



• 379 a 
•2>-7S>b 



system initialization 

W reserve several pages of unpaged memory for save slots 



Fig. 3k 
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Prepare x86 excep. or int. -| 

. Alloc free or oldest save slot 
. Store timestamp & full state 
. x86 regs <- save slot ID, TS 
. EPC<1:0><-01 




i | 



- Handler: RISCtox86 — 

XD contains return-descriptor: 



342 



. Interpret XD: 

- Reformat / repostion result 

- Load FPCW 

. SP <- [SP] // pop RA & argsjK 
XD contains call-descriptor: 



i! 



S2D 

Handler: x86 to RISC — i 



EPC<1:O = 00: 



322 



. LR <- [SP] 
. SP <- SP + 4 
. AP<- SP 

. SP <- SP - 8 // ret area 
. SP <- SP & (-32) 
^XDj-_0_ 

EPC<1:0> = 01: 



37P 



ESI <- SP 



LR<1:Q><- IxperXD 



I 



\ 
\ 

\ 



. x86 regs points to save slot 
. Using TS verify no overwrite 
. Restore full state 
. Free save slot 

.^^f55l^±-P° 

EPC<1:0> = 1x: ^? ^ 



Reformat / repostion the 



. Interpret XD, reposition args » -f • - ) function result per EPC<0> 



. Push LR as RA (ret addr) f - 



SP <- ESI 
EPC<1:0> 



00 



Flat 32-bit "Near" Address Space 




\ r 

» . — Handler: RISC to x86 — 

XD contains return-descriptor: 



. Interpret XD: 

- Reformat / repostion result 

- Load FPSW 

. SP <- [SP] // pop RA & argsJfj 



i 

k 
I' 



:Q> = Ax* 
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IV 

: •a? 



Flat 32-bit "Near Address Space 




Initiate x86 excep. or int. - 

Alloc free or oldest save slofjj 
Store timestamp & full state 
x86 regs<- save slot ID, TS 
EPC<1:0><- 01 




3o^3of, 



Handler: x86 to RISC 




EPC<1:0> = 01: 
. x86 regs points to save slot 
. Using TS verify no overwrite 
^ . Restore full state 
. Free save slot 

. EPC<1 :0> <- 00 3J?& 



® 
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Flat 32-bit "Near" Address Space 




\ 



Reformat / repostion the 
function result per EPC<0> 
SP<- ESI I?9 



EPC<1:0><- 00 ^2? ir 



; / 
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page frame X • 
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page frame Z 



7 entry trace packet 



Entry 


Event Code 


DoneAddr jlMextAddr 




64 bit time stamo 


1 


ret 


x86 context 


physX:f 


2 


new pane 


physY.z 


physY.h 


3 


jcc forward 


phvs Y:i 


physY.k 


4 


jnz backward 


phvsYil 


physXa 


5 


seq; env change 


x86 context 


physXb 


6 


ip-rel near call 


physXc 


physZ.d 


7 


near ret 


physZ:e 


physXif 



■WO 



3-1 o 



Si SI 







acket 


even 


a 


ble 


litiat 


obea 


K 





a 



Code 

i\gz 



Event 



8 

a 

V 
4> 

1 



3 

3 



Is I 

£ a* t- fa 

js a a 
2 to E 



41Z 



/ 

4to 



0.0000 



0.0001 



0.0010 



0.0011 



0.0100 



0.0101 



0.0110 



0.0111 



0.1000 



0.1001 



0.1010 



0.1011 



0.1100 



0.1101 



0.1110 



0.1111 



Default (x86 transparent) event, reuse all converter values 



yes 



Simple x86 instruction completion (reuse event code) 



yes 



Probe exception failed 



yes 



Probe exception failed, reload probe timer 



yes 



no 



Sequential; execution environment changed ~ -f o roe. eve*<+- 



no 



Far RET 



no 



IRET 



Far CALL 



no 



Far JMP 



Special; emulator execution, supply extra instruction data* 



no 



Abort profile collection 



x86 synchronous/asynchronous interrupt w/probe (GRP 0) 



no 



x86 synchronous/asynchronous interrupt (GRP 0) 



x86 synchronous/asynchronous interrupt w/probe (GRP 1) 



x86 synchronous/asynchronous interrupt (GRP 1) 



no 



yes 



yes 



yes 



yes 



yes 



yes 



no 



yes 



yes 



yes 



yes 



no 



yes 



no 



yes 



yes 



no 



yes 



yes 



yes 



yes 



no 



no 



no 



no 



yes 



no 



yes 



yes 



no 



Far call 



Emulator probe 



Emulator probe 



1.0000 



1.0001 



1.0010 



1.0011 



1.0100 



1.0101 



1.0110 



1.0111 



1.1000 



1.1001 



1.1010 



1.1011 



1.1100 



IP-relative JNZ forward (opcode: 75, OF 85) 



no 



yes 



yes 



IP-relative JNZ backward (opcode: 75, OF 85) 



yes 



yes 



yes 



Jnz 



IP-relative conditional jump forward - (Jcc, Jcxz, loop) 



yes 



yes 



IP-relative conditional jump backward - (Jcc, Jcxz, loop) 



yes 



yes 



yes 



Cond jump 



IP-relative, near JMP forward (opcode: E9, EB) 



yes 



yes 



IP-relative, near JMP backward (opcode: E9, EB) 



yes 



yes 



yes 



Near jump 



RET/ RET imml6 (opcode C3, C2 /w) 



yes 



yes 



IP-relative, near CALL (opcode: E8) 



no 



yes 



yes 



yes 



Near call 



REPE/REPNE CMPS/SCAS (opcode: A6, A7, AE t AF) 



no 



yes 



no 



no 



REP MOVS/STOS/LDOS (opcode: A4, A5, AA, AB, AC, AD) 



no 



yes 



no 



no 



Indirect near JMP (opcode: FF /4) 



no 



yes 



yes 



no 



Indirect near CALL (opcode: FF 12) 



yes 



yes 



yes 



Near call 



1.1101 



load from I/O memory (TLB.asi != 0) { not used in TJ ) 

>— i ■■ inn. in i ■ i 1 1 1— «— — — «aB^ca>n n ■.Hi' 'I'Tir'Miiffi^T^MS^Wff*^ ^*J7Tffl 



yes 



no 



v\o v\o rio no 



1.1110 



1.1111 



Default converter event; sequential 



no 



New page (instruction ends on last byte of a page frame or 
straddles across a page frame boundary) 



no 



no 



yes 



no 



no 



no 



no 



a. Used by emulator for new x86 opcodes. Extra information supplied in Taxi_ControLspecial_ppcode bits. 
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